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Abstract 

An alternating sign matrix is a square matrix with entries 1, and —1 such that the sum 
of the entries in each row and each column is equal to 1 and the nonzero entries alternate 
in sign along each row and each column. To some of the symmetry classes of alternating 
sign matrices and their variations, G. Kuperberg associate square ice models with appropriate 
boundary conditions, and give determinanat and Pfaffian formulae for the partition functions. 
In this paper, we utilize several determinant and Pfaffian identities to evaluate Kuperberg's 
determinants and Pfaffians, and express the round partition functions in terms of irreducible 
characters of classical groups. In particular, we settle a conjecture on the number of vertically 
and horizontally symmetric alternating sign matrices (VHSASMs). 

1 Introduction 

An alternating sign matrix (or ASM for short) is a square matrix satisfying the following three 
conditions : 

(a) All entries are 1, —1 or 0. 

(b) Every row and column have sum 1. 

(c) In every row and column, the nonzero entries alternate in sign. 

Let A n be the set ofnxw ASMs. This notion of alternating sign matrices was introduced by 
D. Robbins and H. Rumsey J3| m a study of Dodgson's condensation formula for evaluating 
determinants. W. Mills, Robbins and Rumsey jH] conjectured a formula of the number of n x n 
alternating sign matrices. After more than 10 years, this conjecture was settled by D. Zeilberger 
[T7j and G. Kuperberg in completely different ways. (See 2 for the history of ASMs and related 
topics.) 

Theorem 1.1. (Zeilberger J7|, Kuperberg The number ofnxn ASMs is given by 

Li <" + *" 

Kuperberg's proof is based on a bijection between ASMs and square-ice states in the 6- vertex 
model with domain wall boundary condition, and on the Izergin-Korepin determinant formula for 
the partition function of this model. 

The dihedral group D% of order 8 acts on the set A n of all ASMs as symmetries of the square. 
Each subgroup of D% gives rise to symmetry classes of ASMs. There are 7 conjugacy classes 
of nontrivial subgroups of Dg and it is enough to consider the following symmetry classes of 
ASMs. 

(HTS) Half-turn symmetric ASMs (HTSASMs) that are invariant under a 180° rotation. 
(QTS) Quarter-turn symmetric ASMs (QTSASMs) that are invariant under a 90° rotation. 
(VS) Vertically symmetric ASMs (VSASMs) that are invariant under a flip around the 
vertical axis. 

(VHS) Vertically and horizontally symmetric ASMs (VHSASMs) that are invariant under flips 
around both the vertical axis and the horizontal axis. 
(DS) Diagonally symmetric ASMs (DSASMs) that are symmetric in the main diagonal. 
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(DAS) Diagonally and antidiagonally symmetric ASMs (DASASMs) that are symmetric in 
both diagonals. 

(TS) Totally symmetric ASMs (TSASMs) that are invariant under the full symmetry group 
D s . 

For each symmetry class © = HTS, QTS, • • • , let A® denote the set ofnxn ASMs with symmetry 
©. 

Kuperberg jj] extends his argument in to several classes of ASMs (or their variations) 
including even-order HTSASMs, even-order QTSASMSs, VSASMs and VHSASMs. He finds de- 
terminant and Pfaffian formulae for the partition functions of the square ice models corresponding 
to these classes of ASMs. Also, by ^-specialization, he evaluates determinants and Pfaffians and 
proves closed product formulae for the number of ASMs in many of these classes. However, in the 
enumeration of VHSASMs, he only gives determinant formulae for the partition functions and do 
not succeed in proving the product formula conjectured by Mills. 

In this article, we evaluate the Kuperberg's determinants and Pfaffians by applying determi- 
nant and Pfaffian identities involving Vandermonde-type determinants (see Theorem 3.3 and 3.4 
in Section 3), some of which appeared in and were used for a study of rectangular-shaped 
representations of classical groups. Then we can show that the partition functions corresponding 
to the round 1-, 2-, and 3-enumerations are expressed in terms of irreducible characters of classical 
groups up to simple factors. In particular, we obtain the following formulae for the number of 
some symmetry classes of ASMs. 

Theorem 1.2. (1) The number ofnxn ASMs is given by 

#A l = 3- n( "- 1)/2 dimGL 2 „(5(n-l,n-l)). 

(2) The number of 2n x 2n HTSASMs is given by 

#^2n TS = 3-™ ( "- 1)/2 dim GL 2n (S(n - 1, n - 1)) • S^™" 1 )/ 2 dim GL 2n (5(n, n - 1)). 

(3) The number of An x An QTSASMs is given by 

#^4„ TS = (3-" ( "- 1)/2 dimGL 2n (5(n- l,n- 1)))' • 3~ n ^- 1 ^ 2 dim GL 2n (i(n, n - 1)). 

(4) The number of (2n + 1) X (2n + 1) VSASMs is given by 

#^Jn+i = 3- n ^ dimSp 4n (5(n - l,n- 1)). 

(5) The number of (An + 1) x (An + 1) VHSASMs is given by 

= 3- n(n - 1] dimSp 4 „(5(n - l,n- 1)) • 2- 2n 3" Tl2 dim6 4 „(<5(n + 1/2, n- 1/2)). 

(6) The number of (An + 3) x (An + 3) VHSASMs is given by 

#^r+3 = 3-"("-^ dimSp 4 „(<5(n - l,n- 1)) • 3~" 2 dimSp 4n+2 (5(n, n - 1)). 

Here dimGLjv(A) (resp. dimSp Ar (A), dimOAr(A)) denotes the dimension of the irreducible 
representation of GL^r (resp. Sp N , On) with "highest weight" A (see §2 for a precise definition) 
and 

5(n- l,n- 1) = (n- l,n- l,n- 2,n- 2,- • • ,2,2,1,1), 
5(n, n — 1) = (ri, n — 1, n — 1, n — 2, ■ ■ ■ , 3, 2, 2, 1), 
5(n + 1/2, n - 1/2) = (n + 1/2, n - 1/2, n - 1/2, n - 3/2, • • • ,5/2, 3/2, 3/2, 1/2). 

Each identity in this theorem, together with the Weyl's dimension formula, gives a closed 
product formula for for the number of the symmetry class of ASMs. In particular, we settle the 
Mills' conjecture on the number of VHSASMs 12 Section 4.2]. 

Also we obtain the following formulae for other classes of ASMs. (See Section 2 for a definition 
of each class.) 
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Theorem 1.3. (1) The number of 2n x 2n OSASMs is given by 

#^° s - S-'^- 1 ) dimSp 4 „(5(n - l,n - 1)). 

(2) The number of (8n + 1) x (8n + 1) VOSASMs is given by 

#-As°+i = (3- n(n_1) dimSp 4n (<J(n- l,n- l))) 3 • 2- 2 "3-™ 2 dim 6 4 „(<5(n + 1/2, n- 1/2)). 

(3) The number of (8n + 3) x (8n + 3) VOSASMs is given by 

#C = (3-"("-^ dimSp 4n (5(n - l,n - 1)))" • 3~" 2 dimSp 4n+2 (5(n, n - 1)). 

(4) The number of UASMs of order 2n is given by 

#A^ n = 2"3-"("- 1 >dimSp 4 „(,5(n- l,n- 1)). 

(5) The number of UUASMs of order An is given by 

#^uu = 3-n("-i)dimSp 4n (<J(7i- l,n- 1)) • 3-" ( ™- 1} dim 6 4 „+i(5(n, n - 1)). 

(6) The number of VHPASMs of order 4n + 2 is given by 

#<f+ 2 = (3- n{n -V dimSp 4n (<5(n - l,n- 1)))' . 

(7) The number of UOSASMs of order 8n is given by 

#Al? s = (V "t"- 1 ) dim Sp 4 „(<5(n - 1, n - 1))) 3 • 3-^-^ dim 6 4n+1 (5(n, n - 1)). 

This theorem leads us to closed product formulae for the numbers of these classes of ASMs. 
The product formulae in the VOSASM case are new, though the other case are studied in 0- 

This paper is organized as follows. In Section 2, we review results in [7] on the partition functions 
of square ice models associated to various classes of ASMs, and state our main results which 
relate these partition functions with characters of classical groups. As key tools in evaluating the 
determinants and Pfamans appearing in the partition functions, we use determinant and Pfafnan 
identities involving the Vandermonde-type determinants, which are presented in Section 3. In 
Section 4, we prove the main results. 

2 Partition functions and classical group characters 

In this section, we review results on the partition functions in |Jj and give formulae which relate 
these partition functions to the classical group characters. 

In addition to the symmetry classes of square ASMS, we consider the following classes of square 
ASMs. 

(OS) Off- diagonally symmetric ASMs (OSASMs), that are diagonally symmetric ASMs with 
zeros on the main diagonal. 
(OOS) Off- diagonally and off-antidiagonally symmetric ASMs (OOSASMs), that are diago- 
nally and antidiagonally symmetric ASMs with zeros on the main diagonal and the 
antidiagonal. 

(VOS) Vertically and off- diagonally symmetric ASMs (VOSASMs), that are vertically sym- 
metric and diagonally symmetric with zeros on the main diagonal except for the center. 
The last class (VOSASMs) is not considered in but this arises naturally from UOSASMs defined 
below. It is clear that VOSASMs are TSASMs. And one can show that there are no VOSASMs of 
order 8n + 5 or 8n + 7. 

A vector a = (oi, • • • , a n ) consisting Is, Os and —Is is an alternating sign vector if the sum of 
the entries is equal to 1 and the nonzero entries alternate in sign. Kuperberg [Jj introduces the 
following variations of ASMs. 
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(U) An alternating sign matrix with U-turn boundary (UASM) of order 2n is a 2n x n 
matrix A = (ay)i<j<2n,i<j<n satisfying the following conditions : 

(1) Each column vector is an alternating sign vector. 

(2) For each A:, the vector (a 2 fe-i,i, a 2 k-i,2, • • ■ , a2k-i,n, a%k,n, • • • , 0,2k, 2, a 2 k,i) is an al- 
ternating sign vector. 

Let A^ n be the set of UASMs of order 2n. 
(UU) A alternating sign matrix with U-U-turn boundary (UUASM) of order 4n is a 2n x 2n 
matrix A = (ay)i<j,j<2n satisfying the following conditions : 

(1) For each k, the vector (a 2k -i,i, aafe-1,2, • • • , a2fc-i,2n, a2fc,2n, • • • , a2fe,2, a 2 fe,i) is an 
alternating sign vector. 

(2) For each k, the vector (a^fe-i, a2,2fc-i, • • ■ , 02n,2fc-i) 02n,2fc, • • ■ ,02,2fc,Oi,2fc) is an 
alternating sign vector. 

Let A^ be the set of UUASMs of order in. 
(VHP) A vertically and horizontally perverse alternating sign matrix (VHPASM) of order 
An + 2 is a UUASM A = {cHj)i<ij<2n of order An such that Y^jLi a 2fe-i,j = and 

Ei=i ai,2fc-i = 1 for 1 < k < n. Let Aj^ 2 be the set of VHPASMs of order 4n + 2. 
(UOS) An off- diagonally symmetric alternating sign matrix with U-turn boundary (UOSASM) 
of order 8n is a UUASM A — (a,j)i<,j<4 n of order 4n such that A is symmetric with 
zeros on the main diagonal. Let Ag® be the set of UOSASMs of order 8n. 
For each class © = HTS, QTS, • • • , UOS, we consider the generating function 



A®(x) =Y, X 



where n@(A) is the number of the orbits of —Is under symmetry, excluding any —Is that are forced 
by symmetry. We are interested in the integers A®(0), A®(1), -4® (2), -4® (3), which are called 0-, 
1-, 2- and 3-enumeration of the class © respectively. In |7j, more parameters are introduced for 
some classes, but here we concentrate on these ^-enumerations. 

Now we give formulae for the partition functions of the square ice models associated to various 
classes of ASMs. We use the following abbreviation : 

1 

a(t)=t-~. 

For two vectors of n variables a? = (x±, • • • , x n ), Ij = (j/i, • • • , y n ) and parameters a, b, c, we 
introduce the following n x n matrices : 



M(n; a?, ~y ; a) hj 
M- aT (n;~x, 1 y;a)i ij 
M v (n;~x,li;a)ij 



1 



a(ax i /y j )a(ay :j /x i ) 1 
1 1 



a(axi/yj) a(ayj/xA' 
1 



a(axi/yj)a(ayj/xi) a(axiyj)a(l/ Xiy 3 ) ' 



\t ( -X Tt h ^ < J ( b /yj) (J ( cx t) o-(b/y 3 )o-(c/x l ) ajby^ajcxi) a{b yj )a{c/ Xi ) 
M V u(n; x , y ; a, 0, c)i t j = — r -— r h 



We put 

F(n;~x,~y*;a) 
F v (n;^,lj;a) 



a{axi/yj) a{a/xiy 3 ) a(axiy 3 ) a(ayj/xi) 

II"j=i (T{ax l /y 3 )a{ay ] /xi) 



ni<i<j< n <r{ x j/ x i)<r(Vi/Vj) ' 

n™j=i o{ax l /y 1 )a{ay ] /x l )a{ax l y 1 )(j{a/x l y ] ) 
rii<i<j<„ ^( x j/xi)o-(y l /y J ) ]li<z<j<n o-(l/x t x 3 )a(y z y 3 ) ' 
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and define the partition functions as follows : 



A(n; ~x ■ "y ! a ) — cr ( a )" +n F(n; a?, 1/"; a) det M(n; ~x, ~y; a). 

<j(a)~ n F(n; ~x . ~y; a) det Mht(?i; ~x, ~y\ a), 

a(ay 2n2+2n Fy(n; ~x , ~y ; a) det M v (n; ~x, ~y ; a), 

( j( a )- 2 ™ 2 -" ( T(6/a) _ "ff(c/a)"™(T(a 2 ) 2 " 
x F v (n; "x, ~y ; a) detM UT j(n; "x, ~y ; a, b, c), 

er(a)~ 2 " ~ n Fy(n; He. ~y ; a) det Myu( n ; 1/ ; a > a i a )j 

er(a)~ 2 ™ ~ n F\(n; ~x , ~y ; a) det Muu("-; 2^ 1/ ; a ; a -1 , a 1 ) 5 

er(a)~ 2 ™ 2 ~™F v (n; "x , ~y ; a)(-l)™ det Muu(«; ^\ "y ; a, a, a -1 ). 

We call them the determinant partition functions. 



A^{2n; "x, ~y;a 
Ay(2n + 1; x , ~y ; a 
A^{j(4n; x, y ;a,6,c 



A$ l (4n+ l;"x,"y ;a 

^vHp( 4 "- + 2 ;^*'"y; a 



Remark 2.1. The partition functions of the square- ice models associated to UASMs and UUASMs 
computed in [7] have extra factors 



aja^xf) a{b/yi) 
L = l a{a?) a(b) 



n 



, and ]Q 



q(« 2 x 2 ) aCa 2 /^ 2 ) 
L = l CT (a 2 ) cx(a 2 ) ' 



(2) 

which do not affect the ^-enumeration. So we omit these factors in the definition of Ay and ^uij • 

For a vector of 27i variables ~x — (xi, ■ ■ ■ , X2n) and parameters a, b, c, we introduce the 2n x 2n 
skew-symmetric matrices : 



Mg^(n; ~x ; a) 
Mo(n; a?; a)y 



<t(^/4) 



cr(axj /xi)a(aXi/xj) 

a(xj/xi) 
a(aXiXj)a(a/xiXj) ' 



M o("; ~x \ a, b, c)ij = a{xj/xi) 



M$ ) (n-,~x-,a)i t j = a(xj/xi)cr(xiXj) 



a{aXiXj) <j{a/xiXj) 
1 



a(axj I Xi)a(axi/xj) 



<j(aXiXj)a(a/xiXj) 
Mu (n; x;a, c)ij = cf(xj /xi)a(x i x J ) 

' a(cxi)a(cxj) a(cXi)a(c/xj) a{c/ Xi)a{cXj) a(c/xi)a(c/xj) 



a(aXiXj) 



a(axi/xj) 



aiaxj/xj) 



a(a/xiXj) 



We put 



F QT (n; a?; a) 
Fo(n;"x;a) 
F uo (n;^;a) 



Yil<i<j<2n a ( X j l X i) 

Y\i<i<j<2n ojaXiX^aia/xiXj) 

ril<i<j<2n a ( x j/ x i) 

rii<i<j<2n cr(ax l / x i )(j(ax j / x i )a(ax i x : j)a(a/ XiX 3 ) 



<j<2n 



<i<j<2n 



a(XiXj 



■5 



and define the Pfaffian partition functions as follows : 





"a; 


n) 


= o-(a) 


-2n 2 - 


^ 2n F QT (ji; IS; a) Pf Afg>(n; x; a), 


A (2n; 


^; 


«) 


= ^(a) 


-2n 2 - 


v2n F {n; x; a) Pf M (n; ~x; a), 


A { Q ) (4n;~x;a,b 


c) 


= c- 2 " 


cr(a) 


- 2 " 2+n F (n; jc; a) Pf Af o(™; sc; a, 6, c), 




£*; 


ft) 


= o-(a) 


-4n 2 - 


^uofa a ; ft) PfM™(n; ^; a), 


A^(8n;"S 


;a, 


c) 


= cr(a) 


-4n 2 - 


^a(c/ft)- 2 V(a 2 ) 2 "F uo (n; ^; ft) Pf M$ 


4^(8n + l; 


^; 


ft) 


= o-(a) 


-4n 2 - 


f "F uo (n; a?; a) Pf M^(n; a?; a, a), 


A$,(8n + 3; 


^; 


ft) 


= o-(a) 


-4n 2 - 


^"Fuo^; s£; a) Pf M$(n; x ; a, a" 1 ). 



We call them the Pfaffian partition functions. 

Kuperberg [Jj proves that the ^-enumerations are obtained from these partition functions by 
specializing all the spectral parameters Xx, ■ ■ • , x n , y%, • • ■ ,y n (or x\, - ■ ■ , X2n) to 1. 

Theorem 2.2. (Kuperberg) Let 1 = (1, 1, • • • , 1). If x = a 2 + 2 + a~ 2 , then we have 



A n [x 



HTS/ 
In \ x 



.4 

A 2n+l\ x 

zlVHS / 
/i 4n+lA x 

zlVHS ( 
U 



^2n( x 
A VHP (t 



= A(n; 1 , 1 ;a), 

= A(n; 7, T; a)A^ T {2n; 7 ', 7; a), 
= A v (2n + l;T,T;a), 

= A v (2n + 1; T , T ; a)A^(4n + 1; 7, 7; a), 
= A v (2n + 1; I*, T; a)A^(4n + 3; T, T; a), 
= 2 n A v (2n + l; 7, 7; a), 

= A v (2n + 1;7,7 : a)^(4n; 7, 7; a, v^T, V^l), 
= A v (2n + 1; 7, 7; a)A^ p (4n + 2; 7, 7; a), 



Also we have 



^4j„ ( x 
^2n ( x 
A 4n \ x 
A 8n \ x 



aVOS 

A vos 



\(x 
(x 



^(47i;7;a)Ag^(4n;7;a), 
Ao(2n;7;a), 

A (2n;7;a)^(4n;7;a,6, 6), 
Atf (8n; 7; a)A^ Q (8n; 7; a, y/= 



A%(8n; 1 ; a)A^(8n + 1; l;a), 
^uo (8n; 7; a)A^ (8n + 3; 7; a). 



(2) 



Remark 2.3. The last two identities for VOSASMs were not treated in 7 , but can be proved in 
a way similar to the proof for VHSASMs. 

Let = exp(27r-\/— T/n) be the primitive nth root of unity. Then the correspondence between 
a and x = a 2 + 2 + a~ 2 are given as follows: 



a 


C4 


Ce 


Cs 


Cl2 


x = a 2 + 2 + a~ 2 





1 


2 


3 



To state our results, we introduce the irreducible characters of classical groups. A partition 
(resp. half-partition) is a non-increasing sequence A = (Ai, • • • , A n ) of non-negative integers A^ G Z 
(resp. non- negative half- integers A^ G Z + 1/2). If A and u are both partitions (resp. both half- 
partitions), then A U fi denote the partition (resp. half-partition) obtained by rearranging the 
entries of A and u in decreasing order. For a integer (or a half-integer) r and a positive integer k, 
we define a partition (or a half-partion) S(r) and S 2 (r) by putting 



S(r) = (r, r — 1, r — 2, r — 3, • • • ), S 2 (r) = (r, t — 2, r — 4, r — 6, ■ • ■ ). 



G 



Also we define 

5(r, s) = S(r) U 5(a), S 2 (r, s) = 5 2 {r) U 6 2 {s). 

For a sequence a = (cti, ■ ■ ■ , a n ) of integers or half integers, and a vector ~x = (xi, • • • , x n ) of 
n indeterminates, we define nx n matrices V(a; x) and W±(a; x) by putting 



V{a;H)= (x? , W ± (a; it) = (of ± x t Qj ) 

For a partition A with length < n, wc define 



l<z j'<n 



_^ detI/(A + <5(n-l);^) 

GL W (A a) = _> , (1 

det V[o{n — 1); x) 

det IV (o(n); a; ) 

Then GL„(A;a?) (resp. Sp 2 „(A; a?)) is the character of the irreducible representation GL„(A) 
(resp. Sp 2 „(A)) of the general linear group GL„(C) (resp. the symplectic group Sp 2n (C)). If A is 
a partition with length < n or a half-partition of length n, we define 

~ detW-(\ + 6(n-l/2);^) 

2 n+i(A; a; ) = ; /0 n ->n > ( 3 ) 

det Iv (o(n — 1/2); a; ) 

f det^+(A + g(n-l);^) 

U2nlA ' X) ~ ] detW+(X + 6(n - l);x) . fx =a [ ' 
{ detW+(5{n- l);lc) 1 n ' 

Then Oat(A; a?) is the character of the irreducible representation Oat (A) of the double cover On 
of the orthogonal group Oat. 

Now we are in position to state our main results. Theorem 1.2 and 1.3 in Introduction imme- 
diately follows from the following Theorem and Theorem 2.1. For a vector ) and 
a integer k, we put 

x = ( x l ) " " ) x n)- 

First we give formulae for the determinant partition functions. 

Theorem 2.4. (1) For the partition function associated to ASMs, we have 



n n / 1 

A(n; a?, ^ = 2- 2 +" JT *-"+ V" +1 [T + . perm 

i— 1 i \ 1 

n 

A(n; a?, y>; Ce) = 3~ n ^/ 2 TJ xp+ V" +1 GL 2 „(<5(n - l,n - 1) : * 2 , y 2 ), 



2 I ' 



i=l 



A(n;^,^;C 8 ) = 2-"("- 1 )/ 2 n-r l+1 ?/r l+1 LI (*?+*?)(»? 

n 

A(n; "at, "at; C12) = II x- 2n+2 GL„(5(p,P - 1); ^ 4 )GL„(%, g ); "a? 4 ), 

8=1 

where perm denotes the permanent of a matrix (see ©), and p and g are the largest integers 
not exceeding n/2 and (n — l)/2 respectively. 
(2) For the partition function associated to HTSASMs of order 2n, we have 

n n 

A<&(2n; ^, V; CO = II ^"V* II + 

?— 1 K7 = 1 

71 

A<ft(2n; "a?, V; Ce) = S""^" 1 )/ 2 TJ ip^GLj^^n, n - 1); * 2 , ^ 2 ), 
A%l(n\ x, X] Cs) = 2-™("- 1 )/ 2+ "GL„( ( 5 2 (n, n - 2); k)GL„(* 2 (u - 1, n - 1); T ). 
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(3) For the partition function associated to VHSASMs, we have 



A v (2n+ 1; af, j?;a) = 2" 2 " + 2 " ]J x^yT^ 



x n (^ 2 +?y|)(i + ^ 2 y')pcrm 



A v (2n + 1; ^, V; Ce) = 3-"("- 1 )Sp 4 „(<5(n - l,n - 1); * 2 , y 2 ), 
A v (2n + 1; 1? , Jf; Cs) = 2~ n ^ f[ xf^yT^ 



i=i 

x 



n (^+x 2 )(i+x^)(^+ y |)(i+ y ^), 

Av(2n+1; ^ ;(l2) = n^ 

x 2 „+i(5(n/2,n/2 - 1); ^ 4 )0 2n+1 (S((n - l)/2, (n - l)/2);^ 4 ). 
(4) For the partition function associated to VHSASMs of order An + 1, we have 

n n 

4 2 ^ (4n + 1; ^, V; C 4 ) = 2- 2 " 2 JJ z^ 2 " II (*? + ^X 1 + ^?)> 

i= 1 i)J=l 

4<£ (4n + 1; ^, y>; Ce) = 3"" 2 — — 1 _ 1 , 4 n(^(n + 1/2, n - 1/2); ^ 2 , ^ 2 ), 



l^(4n + 1; ^, ^; Cs) = 2""("- 1 ) 1 

\A l=1 {x l +x l ) 2 



x 2 „(<5 2 (n + 1/2, n - 3/2); ^ 2 )0 2n (<5 2 (n - 1/2, n - 1/2); x 2 ). 
(5) For the partition function associated to VHSASMs of order An + 3, we have 



A™ {An + 3; a?, C 4 ) = 2- 2 " 2 J] J] (* 2 + y 2 )(l + x 2 y 2 



2—1 ijj — 1 



4£(4n + 3; x , y ; Ce) = 3"" S P4n+2 (5(n, n - 1); * 2 , y> 2 , 1), 

A^{An + 3; x , x; Cs) - 2-" 2 +"6 2rl (<5 2 (n, n - 2); ^ 2 )6 2n (S 2 (n - 1, n - 1); ^ 2 ). 

(6) For the partition function associated to UUASMs of order An, we have 

n n 

(4n; ^, jT; ( 4 , ( 4 , U) = 2^^ JJ zr^r 2 " J] (x 2 + ? y 2 )(l + x 2 y% 
4^(4^; ^, jT; Ce, C4, C 4 ) = 3-" 2+ "6 4 „+i((5(n, n - 1); ^ 2 , jf 2 ), 

A^(4n; It, -g; Cs, d, CO = 2-" 2+2 "6 2 „ +1 ( ( 5 2 (n, n - 2);^ 2 )6 2n+1 (S 2 (n - 1, n - l);x 2 ). 

(7) For the partition function associated to VHPASMs, we have 

4 2 ^ p (4n + 2; af , C 4 ) = 2~ 2 " 2 JJ z^ 2 " ft (*? + + *iVj), 

i—1 i)J=l 
n 

4 2 ^ p (4n + 2; af , j?; Ce) - 3~" 2 [] (y 2 + 1 + y~ 2 ) Sp 4 „(<5(n - 1, n - 1); af 2 , jf 2 ), 

i=l 

4hp( 4 " + 2 ; ^> Cs) - 2-" 2+ ™GL 2ll ((5 2 (2n - 2, 2n - 2); ^ 2 , ^~ 2 ). 
Next theorem gives formulae for the Pfaffian partition functions. 
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Theorem 2.5. (1) For the partition functions associated to QTASMs, we have 



i,j<2n 



A™ (4n; fr) = 2- 2 » 2 + 2 " ft ^ 2 "+ 2 II (*? + *?) Hf 

i=l l<i<j<2n \ 1 3 / i<j j; 

2n 

A« (n; ^; Ce) = 3-""+" JJ xr 2 "+ 2 GL 2 „(5(n - 1, n - l);x 2 ) 2 , 

i=l 
2n 

A<V(4n; Cs) = 2-" 2+n J] a;- 2 "+ 2 GL 2n («5 2 (2n - 2, 2n - 2); ^ 2 ), 

i=l 
2n 

Ag)(4n;^;C 4 )=2- 2 " 2 + 2 "n^ 2 " +1 II (*? + *?)> 

i=l l<i<j<2n 
2n 

A™.(n;lt]&) = 3- n2+n H^ 2 "+iGL 2n (^(n- l,n- 1); s 2 )GL 2n (%n- l);^ 2 ), 

i=i 

2n 

^(4n;^;C 8 ) = 2-" 2+ "II^ 2 " +1 II ( x i+ x % 



l<i<j<2n 



where Hf denotes the Hafnian of a symmetric matrix (see (JSJ). 
(2) For the partition function associated to OSASMs, we have 

A (n;^;C4) = 2- 2 " 2+2 "II^ 2 " +2 II (l + ^)Hf' 



fl + .x 2 a; 2% ) 2 / 

i=l l<i<j<2n V 1 3> / l<i,j<2n 



A (2n; ^; Ce) = 3~ n +n Sp in (S(n - l,n - 1); z 2 ). 
(3) For the partition function associated to OOSASMs, we have 



2n 

4 2 ^(4n;a?;C4,6,6)-2- 2 " 2 + 2 ™n^ 2n+1 II (1 + 

i=l l<i<j'<2n 



(4) For the partition functions associated to UOSASMs, we have 

n 

A«(8n;^;C 4 ) = 2- 4 « 2 + 4 «II^ 4 " +4 

i=i 

x IT (^i + x f)i 1 + a; 2 a; 2 )Hf [ — = ^ ^-^ ) 

l<»<j<2n \ v 3 i/v 3 y /l< l J<2n 

A« (8n; ^; Ce) = 3- 2 " 2+2n Sp 4 „(<5(n - l,n - 1); ^ 2 ) 2 , 

n 

A&(8n; ^; C 4 , C 4 ) = 2- 4 " 2 + 4 " II ^ II i*j + ^X 1 + A x % 

i=l l<i<j<2n 

A^(8n; ^; Ce, C 4 ) = 3- 2 " 2+2n Sp 4ll (<5(n - l,n - 1); S 2 )6 4n+1 (S(n, n - 1); ^ 2 ). 

(5) For the partition function associated to VOSASMs of order 8n + 1, we have 

2n 

4 2 > (8n + 1; a?; C 4) = 2 -^^\{ X ^ + 2 JT (a * + + ^ 

i=l l<i<j<2n 

A^(8n + l;ar;Ce)-3- 2 "( 2 "- 1 )/ 2 ' 



x Sp in (S(n - 1, n - 1); ^ 2 )0 4n (6(n + 1/2, 71 - 1/2); ^ 2 ). 
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(6) For the partition function associated to VOSASMs of order 8n + 1, we have 



2n 



i=l l<i<i<2n 

4^(8n + 3; j?; Ce) = 3- 2 " 2 +"Sp 4n (5(n - 1, n - 1); ^ 2 )Sp 4n+2 (5(n, n - 1); l? 2 , 1). 

By combining Theorem 2.3 and 2.4 with Theorem 2.1, we obtain formulae for 0-, 1-, 2-, and 
3-enumerations in terms of the dimensions of irreducible representations of classical groups. In 
particular, we obtain Theorem 1.2 and 1.3 in Introduction. 

Remark 2.6. By using different techniques, Y. Stroganov and A. Razumov HD obtained 
formulae of A(n; a?, "y; Ce)) Av(2n + 1; a; , y ; Ce) an d Ao(2n; a?; Ce) in terms of Vandermonde-type 
determinants, which immediately imply the corredponding formulae in Theorems 2.4 and 2.5. 



3 Determinant and Pfaffian identities 

In this section, we collect determinant and Pfaffian identities, which will be used in the evaluation 
of the determinants and Pfaffians in the partition functions introduced in Section 2. 
The determinant and permanent of a square matrix A = (aij)i<ij< n are defined by 

detA= 2J s S n (v) a l*(l) a 2a(2) ■■ -GW(n), (5) 

o-es„ 

perm A = ^ a io-(i) a 2 ( T(2) • ■ ■ a n <r(n), (6) 

<reS„ 

where S n is the symmetric groups of degree n. And the Pfaffian of a skew-symmetric matrix 
A = [ciij)i<i,j<2n an< i t ne Hafnian of a symmetric matrix B = (&ij)i<i,j<2n are given by 

PfA= 2_j S g n ( Cr ) a o-(l)cr(2)a -(3) (T (4) • • • a .( 2n -l)(T(2n), (7) 
HfB= 2J ^(t(1)<t(2)^<t(3)(t(4) ' ' ' &o-(2n-l)<r(2n) > (8) 

where J-2n is the set of all permutations a satisfying <r(l) < cr(3) < • • • < <j(2n— 1) and <r(2i — 1) < 
a(2i) for 1 < % < n. 

First we recall the Cauchy's determinant identity [3], the Schur's Pfaffian identity m] and its 
variant (0, [H]). 



Lemma 3.1. 



dct ( 1 ^ = ni< t <j<»(^ -^)fa -^) , g * 
e \ x i+vi)i<ij< n n"i=i(^+%) 

\ T - 4- T ■ / . ... _ T - -I- T - 



Pf 



1 %iXjJi<ij<2n i< l < J <2n 1 



n f— ^- en) 



The identities in the next lemma will be used to evaluate some of the determinants and Pfaffians 
appearing in the O-enumerations. The first identity (|12(l goes back to C. Borchardt £Q, and its 
Pfaffian- Flafnian analogues (|13|l and l|14|) are given in 0]. 
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Lemma 3.2. 



det 7 — 7 — \2 = — rf 5 1 — T — \ perm — T — ' ( 12 ) 

Pf (V^V) = IT ^^-Hf(— L_ ) , (13) 



Pf 



(Xj + Xi) 2 J i<ij<2n Ki<j<2n ^ ^ + / l<i,j<2n 



(1 XiXj) 2 J i<j )J -<2n Ki<j<2n ^ V ^ S l<i,j<2n 



. 1 XiX'j VI XjXj J -i^-- 



The following two theorems are the key to evaluate the determinants and Pfaffians appearing 
in the round 1-, 2-, and 3-enumerations. The identities ((15(1 . (|16|l . I|18|l and 1(19(1 already appeared 
in PHI and their specializations are 3 Theorem 16, 17]. 

For ~x — (xi, • • • , a;„) and ~a = (ai, • • • , <x n )i let V pq {x; a) (p + q — n) and W n (~x ; a) be 
the n x n matrices with zth row 

a 2 p— l g— 1\ 

, Xi , 3;^ , * • • , X^ , di , ct^ii^, • • * , diX^ ) , 

(1 + diX™ -1 , ^ + a^" -2 , • • • , x™ -1 + a*) 

respectively. 

Theorem 3.3. For ~x = (xi, ■ ■ ■ ,x n ), ~y = (yi, ■ ■ ■ ,y n ), ~a = (oi, • • • ,a„) and b = • • • ,b n ), 
we have 

ftj-a^ (_i)»(i»-i)/a 



det = v ' det V n >"(¥, y ; a , 6 ), (15) 

/detW r2 (x j ,%;a i ,6 J )\ 1 j^,,*, 



det ( ^W^yilll^lhA ) - ( 1 + c )"" 1 det W 2n+1 fit 1} z-S ~b c) 

Qe M (l-x-V )(V -X ■) / TT" fl-Tlllfll -T) 1 ' y ' ' ' ' 

(17) 

Theorem 3.4. For a? = (a?i, • • • , x 2n ), "a — (a>i, • • ■ , aan) ; an( l 6 = ■ • ■ j ^2«), we have 

Pf ( ( a i ~ a i)(Pj ~ b i) \ = L -dety"' n (^;^)dety n '™(^;"6), (18) 



Xj Xj 



Pf 



l<i,j<2n Y[l<i<j<2n( X 3 Xi ) 

f det W 2 {xi, Xj ; a, , aj ) det W 2 (xi,Xj;bi,bj) 

\ (1 — XiXj)(Xj — Xi) J 1 < ij -< 2n 



Pf 



= ff r ~ wi- rdet^ 2 "(^;^)detVF 2n (^;"b), (19) 

/ det W^ 3 (xi, Xj, z; ai, aj, c) det W 2 (xi, Xj ; hi, bj) 

\ (1 — x i x j)( x j ~ x i) / l<ij"<2n 

C1 4- r) 71 ^ 1 — > 

■detVF 2n+1 (^,z;-a,c)detPF 2n (^; 6). (20) 



ni<*<j<2n(l x i x j)( x j x i) 



We note that the (i,j) entries of the determinant in 1)16(1 and the Pfaffian in (|19[1 can be written 
in the form 

detW 2 (xi,yj-,ai,bj) 1-aibj bj - ai 



(1 - x i y j )(y j - Xi) 1 - x l y J y 3 - x. t ' 
detVF 2 ^ ) det T^ 2 (x^ , x j ; &i , 6j ) 

/ 1 - ajOj | aj ■ — ^ ^ 1 - 6^6^ | bj - bi 

y±. XjXjjyXj Xi j 



1 X/ X/ 1 iZ/ 7 X 1 / V 1 7 Xi 7 ^7 'i 
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Remark 3.5. As a generalization of (|15J) . we can show that 



det 



yj Xi / l<i,j<n 

det y p '«(^; c")™" 1 det V n+p > n+q {x, y \ ~z; ~a, b ,~c). 



(_l)n(n-l)/2 



Ui,j=i(yj - vi) 

The identity (|1 5|1 is the special case where p — q = 0. Also, we can prove 
/ det W p+2 (x l ,y j ,~z]a l ,b j ,~c) 



det 



V (1 - Xiyj)( yj - Xi ) Jl<i,j<n 

1 



det W/ p (^; "c det iy 2n+p ( ^\ "y, ~? ; "a, b , ~c ), 



which generalizes (|16fl and 1|17[) . We also have Pfaffian identities, which are generalizations of l|18|) . 
(fT^|l . and (j20J. See [H] for generalized identities, proofs and applications. 

Proof of Theorem 3.3. The identities (dJ) and |HJ are proven in |101 Theorem 4.2, 4.3]. Here 
we give a proof of (|17|l . 

Let / and J be subsets of [n] = {1,2,- •• , n}, and let L(I,J) (resp. R(I,J)) denote the 
coefficient of a 1 ^ — Yii^i a i Yije j bj on the left (resp. right) hand side of (|1 T|) . If we define the 
automorphisms <7j and a V j by setting 

n ' \xi if I, jyUl> \y 3 if J, 
then it follows from the definition of determinant that 



l<2j <n 



fl 4- rV l_1 — > — > 

of <r» (R(I, J)) = , _ u _ A det W ( * , , , c), 

llij-^iU x iVi)\Vj x i) 

where = (0, • • • ,0). Hence it is enough to show 

/ det W 3 (x i ,y j ,z;0,0,c) 



det 



l<i,j<n 

detT^ 2 ™ +1 (^, -y.z; 0, 0,c). (21) 



Regard the both sides of l|21|) as polynomials in c and denote by /(c) and g(c) the left and right 
hand side of (|21|l respectively. Since /(c) and g(c) have degree at most n in c, it is enough to prove 
the following three claims : 

Claim 1. /(c) is divisible by (1 + c)"" 1 . 

Claim 2. /(0)= 9 (0). 

Claim 3. The coefficient of c" in /(c) is equal to that in g(c). 
First we prove Claim 1. Let A and B be the n x n matrices with (i, j) entry z 2 — 1 and 
(1 — zxi)(l — zyj)/{\ — Xiyj) respectively. Then we have 



detW 3 (x i ,y j ,z;0,0,c) 
(1 - Xiyj)(yj - Xi) 



= A+(c+l)B. 

l<2,j<n 



Here we use the following lemma. (This lemma easily follows from the definition of determinant, 
so we omit its proof.) 
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Lemma 3.6. For n x n matrices X and Y, we have 

det(X + Y) = Y^(-lf {H)+E(K) det A H , K detB H c iK c, 

H,K 

where the sum is taken over all pairs of subsets H and K C [n] with = #if . And Xh,k (resp. 
Yh c ,k c ) denotes the submatrix of X (resp. Y) obtained by choosing entries with row indices in H 
(resp. H c ) and column indices K (resp. K c ), and E(-ff) = J2heH' ^(-^0 = J2kei< ^' 

Applying this lemma and using the fact that rank A = 1, we see that 

n 

/(c) = (c+l)"dcti? + ( C +l)"- 1 (-l) h+k (z 2 -l)detB [n] _ {hh[n] _ {k} . 

h,k=l 

Therefore /(c) is divisible by (c + 

Next we prove Claim 2. It follows from the definition of determinant that 



/(0) = dct 
.9(0) 



{z-Xi){z- Vj ) 

1 - X l TJj 
1 



— det W 2n+1 (x, ~y, z; ~0 , "0 , 0). 



By using the Cauchy's determinant identity and the Vandermonde determinant, we see that 

nr=i(* - ^x* - Vi) rii<i<i<nfe - x *x% - y%) 



/(0) = 5(0) 



Claim 3 can be proven similarly. 



□ 



Proof of Theorem 3.4. The identities {TBJ) an d CHI are verified in [113 Theorem 4.7, 4.4]. Here 
we give a proof of (|2~0")l . 

Let / and J be subsets of [n] = {1,2,- •• , n}, and let L(I,J) (resp. R(I,J)) denote the 
coefficient of a 1 ^ = Jlie/ a * IX/ej &j on the left (resp. right) hand side of (|2t)(l . Let 07 be the 
automorphism defined by 

r x 1 - 1 ifi€/, 
xt if i ^ /. 



07(27) 



Then, by the same argument as in the proof of |101 Theorem 4.4], we can compute 07 (L(/, J)) and 
ax(R(I, J)). We put K=(lnJ c )U {I c n J) and define Z(K) to be the 2n x 2n skew-symmetric 
matrix with entry 



1 



1 iC ^ X j 



det W 3 (x i ,x J ,z] 0, 0, c) if i € K and j € if, 



i 



■ det W 3 (iCi, ij, z; 0,0, c) if i G if and j e K c , 



1 *^ J 



det W (27, 27, z; 0, 0, c) if i e K c and j e K, 
- detW 3 (x i ,x j ,z- 1 0,0,c) if i e K c and j S K c . 



Then we have 



and 



a I (L(I,J)) = Y[x7 1 -Pf Z(K), 



a I (R(I,J)) = (-iy^l[x- 1 
where 



(c+1)' 



16/ 



s(K) = #{(i,j)€Kx[2n]:i<j}, 



det VK 2n+1 (^,z;"0,c), 
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and the products are taken over all pairs k < I and k 1 < I' such that 

(k, I) G (if x if) U (if c x K c ), (k', I') G (if x if c ) U (if c x if). 
Now the proof is reduced to showing the following identity : 

(c+ I)" -1 



Pf Z(if) = (-i) s(if) 



detW 2n {x,z;0,c), 



(22) 



(23) 



where the products are taken over all pairs k < I and k' < I' satisfying l)22[l. 

Regard the both sides of (|2"3"|) as polynomials in c and denote by /(c) and g(c) the left and right 
hand side respectively. Since /(c) and g(c) have degree n, it is enough to show the following three 
claims : 

Claim 1. /(c) is divisible by (c + l)"" 1 . 
Claim 2. /(0)= fl (0). 

Claim 3. The coefficient of c™ in /(c) is equal to that of g(c). 
First we prove Claim 1. Let A(K) and B(K) be 2n x 2n skew-symmetric matrices with 
entry 



B{K)i 



-{z 2 - l)(xj — Xi) if % G if and j G if, 

-(z 2 - 1)(1 - XiXj) if i G if and j ^ if, 

(z 2 — 1)(1 — XiXj) if i ^ if and j G if, 

(z 2 — l)(a; 3 — Xi) if i £ if and j ^ if, 



-(1 — za;,)(l — zxj) 



— (1 — za:,)(l — zxj) 

(1 — ZXi)(l — ZXj) 

(1 — zxi)(l — zxj) 



1 £ X J 



X *i X i 



Then we have 



1 X i X j 

Z(K) = A(K) + (c + l)B(K). 



if i G if and j G if, 

if i G if and j ^ if, 
if i ^ if and j G if, 
if i g" if and j g" if. 



Here we use the following lemma. 

Lemma 3.7. f |151 Lemma 4.2 (a)] If X and Y are 2n x 2n skew-symmetric matrices, then we have 

Pf(X +Y) = ^(_i)£(ff)-#ff/2 Pf(Jfff) PfCYffe), 
if 

where i? runs over all subsets H C [2n] with #iJ even, and Xtf (resp. Yho) denotes the skew- 
symmetric submatrix obtained from X (resp. Y) by picking the entries with row-indices and 
column- indices in H (resp. H c ). 

If H is a subset with #£f even, then we have 

Pf(x j -x i ) iJeH = if #ii>4, 
and, by applying the automorphism annK, we see that 

Pf (A(K)h) = 0. if #ii>4. 
Hence, by using the above lemma, we have 
PiZ(K) = (c+ l)"Pf B(K) 

+ E (-I) 2n(2 " +1)/2 "^^ 1 (C+ l)"- 1 Pf(A(if) fe ,)Pf(S(^)[2„]- {fc , i} ) 
l<fc<i<2ri 

Therefore Pf(Z(if)) is divisible by (c+l) n_1 . 
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To prove Claims 2 and 3, we introduce the 2n x 2n skew-symmetric matrix Y(K) by putting 

3*4 Xi 



Y{K)i 



Then we have (see ^3 Lemma 4.5]) 



1 X ' i X j 



-l 
l 

Xj 



X i X n 



if i € K and j £ K, 

if i 6 if and j ^ if, 
if i ^ K and j e if, 

if i K and j K. 



p f y,A', . (-d*> n^n T 



xi - x k 



k<l 
k,leK 



k<l 
k,l<£K 



XkXl 



(24) 



The constant term and the leading coefficient of /(c) = Pf Z(K) are given by 

[c°] Pf Z{K) = Pf ((z - Xi ){z - xjMK)^^ , 
[c n ] PiZ(K) = Pf ((1 - zxi)(l ~ ^y^tf)^^ • 

On the other hand, the constant term and the leading coefficient of det W 2n { ~x , z; , c) are 

[c°] det W 2n (~x, z; ~0 , c) = det W/ 2 "(~z , z; ~0 , 0), 

[c 1 ] det W 2n (x, z; ~0 , c) = z 2rl det VK 2 "(^, aT 1 ; "0 , 0). 

Hence, by using (|24|) and the Vandermonde determinant, we see that 

2/i 



[c°]f(c) = [c°]g(c) = (-iyW H(z - Xi ) TJ j 



xi - x k 



k<l 
k.leK 



XkXl 



n i 

k<l 
k,leK c 



xi - x k 



[c"]/(c) = [ C >(c) = (-l)«I](l 



ZXi 



n%l ~ x k T~T 
, , 1 - x k x, M T 



XkXl 



xi - x k 



k<l 



fc<! 

k,ieK c 



x k xi 



This completes the proof of Theorem 3.4. 



□ 



The round determinants appearing the 2- and 3-enumerations can be evaluated by applying 
Theorem 3.3, but we need the substitution y — x in the resulting determinants to obtain simple 
expressions, except for the 2-enumeration of ASMs and VSASMs. The following lemma will be 
used in this second step. The proof is done by elementary transformations and left to the reader. 

Lemma 3.8. Let a = (a±, ■ • • , a2n) be a sequence of half-integers, and let a? = (xi, • • • , x n ) and 
~y = (yi, • • • ,y n ) be two vectors of n variables. 

(1) Let V'(a; x , y ) be the 2n x 2n matrix with entry 

1 ' x" 3 if 1 < i < n, 

(-iy~ 1 y"l n if n + 1 < i < 2n and 1 < j < n, 
^ (-l) J ~ n y"l n if n + 1 < i < 2n and n + 1 < j < 2n. 



Then we have 



where 



det V'(a; ~x, ~x) = (_i)»(™+i)/2 2 ™ det V(/3; x) det V(f3'; x), 
(3 = (ai,a n+ 2, as, a«+4, ■■■), = (a„+i, "2, a n +3, «4, ■ • • )■ 
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(2) Let W±(a; x , y) be the 2n x 2n matrix with entry 

J x* 3 ± x i Qj if 1 < i < n, 

1 (-I) 3 " 1 (l£_„ ± iC2 ) if « + 1 < * < 2n, 



Then we have 

detWi(a;"x,"x) = (-l)»(«+ 1 )/ 2 2 B det W ± ( Tl x) det ^(7'; 

where 

7 = (ai, a 3 , a 5 , ■ ■ ■ , a 2n -i), 1 = ("2, a 4 , a 6 , ■ ■ ■ , a 2n )- 
(3) Let U(a; ~x, y) be the 2n x 2n matrix with (i, j) entry 

\X; 3 + Xi 013 if 1 < i < n, 



Then we have 
where 

4 Proof 



, (-l)^ 1 - Vi-i) if n + 1 < z < 2n. 

det J7(a; ~x, ~x) = 2 n det V(a; ~x, ~x~ r ), 
a = (-ai,a>2, ~a 3 , a 4 , ■ ■ ■ , -a 2n -i,a2n)- 



In this section, we prove Theorem 2.3 and 2.4 stated in Section 2. Since the arguments are the 
same, we illustrate how to compute the partition functions v4y^(4rt +1; x , y ; £g) and v4y^(4n + 
3; a?, "y; Ce), which correspond to the 1-enumerations of VHSASMs. (For other cases, see the end 
of this section and the tables there.) 

First we consider the case of VHSASMs of order 4n + 1 and compute the partition function 
x , y ; C6j- A simple computation shows 



M vv (n; ~x, ~y ; a, a, a)ij 

= a(a)(l-x 2 i )(l-y?) 



x\ + y] 1 + x\y) 



a 4 4- 1 n 4 4- 1 

4> 4 u ^ 2 2 4 4 i 1 ^ 2 2 



If a = (g, then we have 

n 

Muu(n; s?, y>; Ce, Ce, Co) = ^(Ce)" I^ 1 ~ ^X 1 ~ »i) det 



y]-x\ \-x\y]) x 



<i,j<n 



Now, by applying the identity (|16(l in Theorem 3.3 with 

6 6 4 1. 4 

we have 

det ("4^-4+ j— ^4 ^1 =TTH ? g ^det^ 2 "(^ 6 ,^ 6 ;^ 4 ,^ 4 ). 

By applying elementary transformations and by using the definition of orthogonal characters (J2J , 
we have 

det W 2n {~x 6 ,lj 6 ;^ 4 : lj 4 ) 

n n 

= IK n+ V n+1 II (*3 - ^X 1 - - «?)(* - y'v") II (y 2 - * 2 Xi - ^) 

x 6 4 „((5(7i + l/2,n-l/2);^ 2 ,^ 2 ). 
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Then, after some computation, we obtain 

4^(4n + 1; 7; Ce) = 3"" 2 — L- ^ O fa (^(n + 1/2, n - 1/2); af 2 , jf 2 ). 

Next we consider the cases of VHSASMs of order An + 3. A simple computation shows that 
Muu(n; ~x, ~y \ a, a -1 , a -1 )i,j 



<r(a) 



a 4 + a 2 + 1 

z 4 y) + 2/f + ^ 2 y 4 + a;? g + y i) + 2a; ^i 



a 4 + 1 



4vj + v$ + Ay] + A- a + a a 2 +1 (4yt + 1) + 2a;2 y 2 

a 4 + 1 

+ 1 ~ X i y j 

If a = ^6, then (a 4 + a 2 + 1) /a 2 = and we have 
det Muu(n; sc , ~y ; Ce, Q 1 , Q 1 ) 

<r«eV 17(1 - , 4 )(1 - , 4 ) det ( X M±1±M±^M \ (25) 

Here we note that the numerator of the (i, j) entry is equal to 

4v) + AVj + %i$Vj + A + Vj = Ay] ■ Sp B ((l, 0, 0); x 2 ,y 2 , 1). 

Instead of evaluating directly the determinant on the right hand side of l|25|l. we consider the 
determinant 

/ x 2 y 2 z 2 Sp 6 ((l,0,0);:r 2 ,y 2 ,z 2 ) \ 

^ (A + v] + Avf)^y] + 1 + Ay]) ) 1<ij<n ' 

Comparing the definitions of the symplectic character Sp 6 ((l,0,0)) and the matrix W 3 , we have 

detW 3 {x 6 ,y 6 ,z 6 ;-x 4 ,-y 4 ,-z 4 ) = x s y 8 z 8 ■ Sp 6 ((l, 0, 0); x 2 , y 2 , z 2 ) det W~ (1, 2, 3; x 2 , y 2 , z 2 ). 
Hence we see that 



det 



x 2 z/ 2 z 2 -Sp 6 ((l,0,0) ;a ; 2 ,;/ 2 ,z 2 ) 

(A + yj + Av])(Ayj + i + 



l 



(1 - Z *)n n » =l (l - x f)(l - yf) {1 - X 2 Z 2 ){1 _ y 2 z 2 )[z 2 _ x 2 )(z 2 _ y 2 } 

x det 



' det W 3 (xl y],z]\ ~A, ~Vy -*$) ' 

(1 - - x?) 

Now we can apply the identity (|17|l in Theorem 3.3 with 



l<z,j<n 



6 6 6 4 l 4 4 

i Vj ^Vj, z—>z, <n -> -Xj , 6^ -> , c -> -z . 

By applying elementary transformations and by using the definition °f symplectic characters, 
we have 

det W 2n+1 (^ e , y> 6 , z 6 ; -^ 4 , - y> 4 , -z 4 ) 

n n 

l (i - - 4 ) II A n yf n - ^)(! - yf)( z2 4){z 2 - yf)(i - ^ 2 )(i - ^ 2 - 2 ) 



z 2 "' 



i=l i=l 



x H ;,; xf)(l - ^)(^ - y 2 )(l - y 2 y 2 ) \{ (y 2 - x 2 )(l - xfy 2 ) 

l<i<j<n ij — 1 

t2 ~rf2 ^>2\ 



x Sp 4n+2 (5(n,n- 1); x\ y\ z 1 ). 
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After canceling the common factors, we can substitute z = 1 and obtain 

et {(l + x\y] + x\y%x\ + x\y] + yf) ) 
1 

" n - J= i (i + ^1 + ^Wl + Av) + yf) 

n 

x II x2 "y* n II ^ - ^X 1 - x2 i x Wi - rfX 1 - • S P4n +2 ^(^, n - 1);U 2 ,^ 2 , 1). 

i—1 l<i<Cj<n 

Then, by some computation, we have 

4^(4n + 3; x, y; C 6 ) = 3-" 2 Sp 4n+2 (<5(n, n ~ 1); x 2 , ^ 2 , 1). 

This completes the proof of Theorem 2.3 (4) and (5) at a — (§. 

The determinants and Pfaffians in the O-enumerations (or in the case of a — (4) are evaluated by 
families of the Cauchy's identity and the Borchardt's identity. The determinant/Pfaffian identities 
used in the evaluation arc listed in Table 1. 



Table 1: O-enumeration 



Partition functions 


Identities 


specialization 


A(n; ~x , ~y; U) 




xi -» 2/i -> y 2 


A$<(n;l2,~y*',C4) 


© 


a* -» 2/t -> 2/ t 2 


A v (2n + l;"x,~y;C 4 ) 




x s -> + x^ 2 , y t -> y^ z 


^vH S ( 4n + 1 ;^' If; CO 


© 


Xi -> x? + x" 2 , -> y~ 2 






Xj -> x 2 +x" 2 , i/, -> j/~ 2 


A^j(47i;"x,"y;C4,C4,C4) 




x s -> x 2 + x~ 2 , -> j/~ 2 


AV 2 HP (4n + 2;^, ^;C4) 


© 


x* -> x 2 + x" 2 , yi -► y~ 2 


A^n-^-U) 




x l -> X 2 


A^(4n;^;C 4 ) 


m 


2 

x^ ■ ? X^ 


Ao(2n;^;C 4 ) 




Xi — > V-lzf 


A^ {An^;U) 


CD 


Xj ^ \/ lx j 


A§ } Q {%n\~x '5(4,(4) 


03 


Xi — > x 2 + x~ 2 


A [2) (8n;~x;( 4 ,(4) 


GDI 


Xi — > x 2 + x~ 2 


^(8n + l;^;C 4 ) 


GDI 


Xi — > x 2 + x~ 2 


^(8n + 3;^;C 4 ) 


GDI 


Xi — > x| + x~ 2 



When we compute the partition functions in the 1-enumerations, we apply the identities in 
Theorem 3.3 and 3.4 to evaluate the determinants or Pfaffians, and compare the resulting deter- 
minants with definitions of classical group characters. The variations of the arguments are 
summarized in Table 2. 

For the 2-enumerations, the determinant appearing in A(n; x , y ; (§) (resp. Ay(2n+1; x , y ; (§)) 
can be evaluated by applying the Cauchy's determinant identity with x» — > x\ and yi — > y 2 (resp. 
Xj by x 2 + Xj~ 2 and yi — > y 2 + y~ 2 ). The other determinants in the determinant partition func- 
tions are computed by using the identities (|T5)l and (|TT))l . and then by applying Lemma 3.8 to the 
resulting determinants, where we have to put y = x . Also the round Pfaffian partition functions 
for a = Cs are computed by using the identities (fTTTf) . (fT%|) and lfT^)l. Similarly, we can deal with 
the round 3-enumerations. See Table 3 and 4 for the details. 

5 Discussion 

In this paper, we settled a conjecture on the number of VHSASMs. However, the enumeration 
problems of odd-order HTSASMs, odd-order QTSASMs, and odd-order DSASMs are still open. In 



18 



Table 2: 1-enumeration 



Partition functions 


Identities 


specialization 


A(n;~x,lj ;Ce) 




^ -> a* -> xf , yi -> yf , 6 ; -> 


^htW x > y ;Ce) 




.Xi -> xf , a, -> xf, yi -> yf , b t -> y 4 


A v (2n+ 1; x*,"y ; Ce) 


eg 


Xi ► Xj , ai > Xi , yi >■ yi , bi > yi 


^Vhs( 4 " + 1 ; a;. y;C 6 ) 


mi 


6 4 6 i. 4 

Xi > Xi , di > Xi , yi > y,j , Oi > yi 


4ra(4n + 3;-£,~y;C6) 


113 


6 4 6 l 4 6 4 

Xi ► Xi , 0-i ► Xi , yi ► yi , Oi > yi , z > z , c ► z 


A^ P (4n + 2; a;, y;Ce) 


tun 


Xj -> x°, Oi -> -xf , yi -> yf , 6* -> -yf 


A^(4n;^;C 6 ) 




>■ x^ , o.j * x^ , bi > x^ 






Xj ■ * x^ , cij ^ ^j i ^2 ^ &i 


A (2n; ^;Ce) 


d 


Xi ► Xj ; &i > ~X^ , &j ► 


A^(8ri;"x;Ce,C4) 


CSI 


Xj ^ Xj , <Xj > ™Xj , foj * ~Xj 


A^(8n+l;^;C 6 ) 




Xj * Xj , £Jj * Xj ; bi >■ Xj 


A$,(8n + 3; x;Ce) 


1201) 


6 4 L 2 6 4 

X-£ ~ ^ Xj 5 tt^ ^ "^j 7 2 ^ ~"*^j 7 ' 



Table 3: 2-enumeration 



Partition functions 


Identities 


specialization 


Lemma 3.8 


A(n\~x,~y ;Cs) 





Xi ► Xj , yi ► y^ 








x, xf, a,i^ xf, y l -> -y 4 , 6i -> -yf 


(i) 


A v (2n+1;^, jT;C 8 ) 


© 


Xi -> xf + if', y* -> yf + yr a 




A^s(4n+1;^, y^Cs) 


m 


Xi -> xf, ^ -> xf, y l -> -yf, 6* -> -yf 


(2) 


^VHs( 4n + 3 ; ~V'Cs) 


m 


Xi -> x 4 , Oj -> -xf , y l -> -yf, 6, -> yf 


(2) 


A^(4n;"^,"y ;C8,C4,C4) 


m 


Xj -> x 4 , Oj -» -xf , yj -> -yf, bi -> yf 


(2) 


i4^p(4n + 2;s?,|7;C8) 


m 


x, -> x 4 , ai -» xf , y l -> -yf, 6i -> yf 


(3) 


A^(4n;^;Cs) 


m 


Xj ^ Xj , (Xi ^ X^ , 6j > X^ 




4^(4n;^;C 8 ) 


CD 


2 

Xj ^ X^ 





Table 4: 3-enumeration 



Partition functions 


Identities 


specialization 


Lemma 3.8 






Xj -> xf, fli -> xf , yi -yf, &i -yf 


(i) 


A v (2n + l;¥,"y;Ci2) 




Xi -> xf, ai -> -xf , y, -> -yf , 6 4 yf 


(2) 


A^(4n; x;Ci 2 ) 


CHI 


Xj ^ X^ , Q-j ^ X^ , 6j * X^ 





19 



our point of view, the remaining conjectures (see ^2) on HTSASMs and DSASMs are reformulated 
as follows: 

Conjecture 5.1. (1) The number of (2n + 1) x (2n + 1) HTSASMs is given by 

#-< T +! = 3-" 2 (dimGL 2n+1 (<5(n, n - l))) 2 . 

(2) The number of the (2n + 1) x (2n + 1) DSASMs is given by 

#^2n+i = 3- n(n - 1)/2 dimGL 2n+1 (6(n,n-l)). 

Our results (Theorem 1.2) says that, for example, there is a bijection between the set of n x n 
ASMS and the set of all pairs (T,M) of semistandard tableaux T of shape S(n — l,n — 1) with 
entries 1, 2, • • • , 2n, and triangular array M of Is, Os and —Is of order n. It would be interesting 
to find bijections proving the formulae in Theorem 1.2. Also it is important to clarify the intrinsic 
reason why classical group characters appear in the enumeration of symmetry classes of ASMs. 
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